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(57) Abstract: The present invention provides exteded depth of field or focus to conventional Phase Contrast imaging systems 
(100). This is accomplised by including a Wavefront Coding optical element (422) in the system to apply phase variations to the 
wavefront transmitted by the Phase Object (408) being imaged. The phase variations induced hy the Wavefront Coding mask code the 
wavefront and cause the optical transfer function to remain essentially constant within some range away from the in -focus position. 
This provides a coded image (418) at the detector (420). Post processing (424) decodes this coded image, resulting in an in-rocus 
image over and increased depth of field. 



WO 02/09951 J 



PCT/US02/01304 



WAVEFRONT CODING PHASE CONTRAST IMAGING SYSTEMS 
BACKGROUND OF THE INVENTION 
FIFID OF THE INVENTION : 

This invention relates to apparatus and methods for using Wavefront Coding 
to improve contrast imaging of objects which are transparent, reflective or 
vary in thickness or index of refraction. 

DESCRIPTION OF THE PRIOR ART : 

U.S. Patent No. 5,748,371, issued May 5, 1998 and entitled "Extended Depth 
of Field Optical Systems," is a relevant reference. 

Most imaging systems generate image contrast through variations in 
reflectance or absorption of the object being viewed. Objects that are 
transparent or reflective but have variations in index of refraction or 
thickness can be very difficult to image. These types of transparent or 
reflective objects can be considered "Phase Objects". Various techniques 
have been developed over the years to produce high contrast images from 
essentially transparent objects that have only variations in thickness or 
index of refraction. These techniques generally modify both the illumination 
optics and the imaging optics and are different modes of what can be called 
"Contrast Imaging". 

There are a number of different Contrast Imaging techniques that have been 
developed over the years to image Phase Objects. These techniques can be 
grouped into three classes that are dependent on the type of modification 
made to the back focal plane of the imaging objective and the type of 
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illumination method used. The simplest Contrast Imaging techniques modify 
the back focal plane of the imaging objective with an intensity or amplitude 
mask. Other techniques modify the back focal plane of the objective with 
phase masks. Still more techniques require the use of polarized illumination 
and polarization-sensitive beam splitters and shearing devices. In all of 
these Contrast Imaging techniques, modifications to the illumination system 
are matched to the modifications of the imaging optics. 

Contrast Imaging techniques that require phase modification of the back 
focal plane of the imaging objectives we call "Phase Contrast" techniques. 
These techniques include traditional Phase Contrast as described by Zernike 
in 1958 (see Video Microscopy, Inoue and Spring, 1997, Plenum Press, NY), 
those including variations in amplitude and phase on the back focal plane of 
the objective (see, for example US patent # 5,969,853), variations 
incorporating spatial light modulators (see, for example, US patent 
#5,751,475), and variations of Phase Contrast imaging requiring multiple 
images (see, for example, US patent # 5,969,855). 

Figure 1 (Prior Art) is a block diagram of a conventional Phase Contrast 
imaging system 100, which shows generally how Phase Contrast Imaging 
techniques are implemented. This figure illustrates imaging a phase object 
108 through transmission, but those skilled in the art will appreciate that 
the elements could just as simply have been arranged to show imaging 
through reflection. 

Illumination source 102 and illumination optics 104 act to produce focussed 
light upon Phase Object 108. A Phase Object is defined here as an object 
that is transparent or reflective and has variations in thickness and/or index 
of refraction. Obviously almost any real life object is, strictly speaking, a 
Phase Object, but only objects having enough thickness or index of 
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refraction variation to be difficult to image will require special imaging 
techniques. A Phase Object can be difficult to image because the majority 
of images typically are formed from variations in the reflectance or 
absorption of the object. 

Objective lens 110 and tube lens 114 act to produce an image 118 upon 
detector 120. Detector 120 can be film, a CCD detector array, a CMOS 
detector, etc. The Phase Contrast techniques are implemented by using 
illumination mask 106 and objective mask 112. Traditional imaging, such as 
bright field imaging, would result if neither an illumination mask nor an 
objective mask were used. 

Figure 2 (Prior Art) shows a first embodiment of an illumination mask 106a 
and objective masks 112a, 112b, and 112c constructed and arranged for 
Phase Contrast Imaging. Illumination mask 106a consists of an annular 
region 202 of high transmittance and the remaining regions being low to 
zero transmittance. 

Objectives masks 112a, 112b, and 112c have phase and transmittance 
variations essentially conjugate to the transmittance variations of the 
illumination mask 106a. With no specimen, the majority of the light from 
illumination mask 106a will traverse the annular regions (204, 206, or 208) 
of the objective masks. In objective mask 112a this annular region 204 
contains a phase retarding material with the transmittance of each portion 
of the mask being 100%. In objective mask 112b the annular 206 region 
contains a phase retarding material as well as amplitude attenuation 
material. The remaining regions of objective mask 112b have 100% 
transmittance. In objective mask 112c the annular region 208 contains 
amplitude attenuation material but no phase retardation material. The 
remaining regions 210 of objective mask 112c contain phase retarding 
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material and no amplitude attenuation material. 

In operation, the light that travels through illumination annulus 202 that is 
not significantly diffracted by object 108 (as for example when a phase 
gradient is not present) traverses the conjugate annular regions 204, 206, 
or 208 of objective masks 112a, 112b, or 112c respectively. When using 
objective mask 112a this undeviated light is phase retarded. When using 
objective mask 112b the undeviated light is phase retarded and attenuated. 
When using objective mask 112c this light is only attenuated, but not phase 
retarded. The light that is diffracted or scattered by object 108 passes 
mainly through regions of the objective masks other than the annulus. In 
objective mask 112a the diffracted light is neither phase retarded nor 
attenuated. When combined with the undeviated light, brought into phase 
through the phase retardance at the annulus 204, constructive interference 
at the image results and the object appears lighter than the background 
image. In objective mask 112b the diffracted and undeviated light are also 
brought into phase due to the phase retardance of annulus 206, but the 
background image intensity is reduced by the amplitude attenuation of 
annulus 206. In objective mask 112c the diffractive light and the undeviated 
light are made to destructively interfere at the image so that the image of 
the Phase Object appears darker in the image than the background. The 
background is also reduced by the amplitude attenuation of annulus 208. In 
each of these variations, Phase Contrast imaging converts phase differences 
in the Phase Object into intensity differences in the formed images. 

Figure 3 (Prior Art) shows a traditional diagram explaining the operation of 
Phase Contrast imaging accomplished by a conventional imaging system 
such as 100, in Figure 1 (Prior Art). See Video Microscopy, Inoue and 
Spring, Plenum Press, 1997, NY for other similar diagrams. The illumination 
mask such as 106 produces essentially a hollow cone of light from the 
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condenser. Light that is not diffracted or scattered from the Phase Object 
passes through the conjugate regions of the objective mask such as the 
annulus on objective mask 112a. Light that is diffracted or scattered from 
the Phase Object does not pass through the phase retarding annulus of the 
5 objective mask. The diffracted light has been phase retarded by the Phase 

Object 108. Zernike showed that many Phase Objects can be modeled as 
imparting a pi/2 phase delay to the diffracted light. When the undeviated 
light is also delayed by an equivalent pi/2 phase both the diffracted and 
undeviated light arrive at the image plane in phase and constructively 

1 0 interfere to produce an image of the Phase Object lighter than the 

background. By changing the relative phases between the diffractive and 
undeviated light, as well as the relative intensity of the diffracted and/or 
undeviated light, the image of the Phase Objects can be lighter or darker 
than the background, and the background intensity can be raised or 

1 5 lowered. 

A mathematical description of Phase Contrast imaging is as follows. 
Represent the incident light wave by sin(wt), where t denotes time and w 
denotes radian temporal frequency. Assume that illumination mask 106a 
and objective mask 112b of Figure 2 are used. When the incident light does 
20 not pass through the specimen, this undeviated light intercepts the objective 

mask at the phase annulus and is phase retarded and attenuated. This light 
can be represented as: 

S 0 = a sin(wt - <|>) 

where $ is the amount of phase retardation at the annulus and a, 0 <= a <= 
25 1, is the transmittance of the light at the annulus. The intensity of the image 

formed from this signal can be shown to be proportional to the time 
average of the square of S 0 . This time average is given as: 
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< 



S } > = a 2 / 2 



0 



When the incident light passes through the specimen, the light is delayed 
(and diffracted or scattered) and can then be represented as: 

S., = sin(wt - 8), 

5 where 8 is the phase delay due to the Phase Object. The value of this phase 

delay is dependent on the size of the Phase Object, the local surface slope, 
and the change in index of refraction. It is this phase delay due to the 
Phase Object that is transferred to image intensity with Phase Contrast 
imaging. With the identity sin(a - b) = sin(a) cos(b) - cos(a) sin(b), S, can 

I 0 be written as: 

S 1 = sin(wt) cos(S) - cos(wt) sin{8) 

The first term of the specimen-diffracted light S! is identical to the 
undeviated light of S 0 with a weighting related to the amount of phase delay 
due to the Phase Object. This first term will then be modified at the 
1 5 objective mask 112b by being phase retarded and attenuated. The light 

after the objective is then described as 

S,= a sin(wt - <|>) cos(8) - cos(wt) sin(8) 

Squaring S, yields: 

S, 2 = a 2 cos(d) 2 sin(wt - <|>) 2 + 

20 sin(8) 2 cos(wt) 2 

2 a sin(8) cos(8) sin(wt - <|>) cos(wt) 
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With the identity sin(a)cos(b) = [sin(a+b)+sin(a-b)]/2 this squared signal 
can be written as: 



= a 2 cos(8) 2 sin(wt - *) 2 + 

5 sin(8) 2 cos(wt) 2 

a sin(5) cos(5) [ sin(2wt - <|)) - sin(4>)] 
The time average of this squared signal can be shown to be given by: 

< S, 2 > = [a 2 cos(8) 2 + sin(8) 2 + 2 a cos(8) sin(8) stn(<t>)] / 2 

For small phase delay 8 due to the Phase Object, we can use the 
1 0 approximations that that cos(8) - 1, sin(S) ~ 8, and S 2 - 0, and can rewrite 

this time average as: 

< S t 2 > - ( a 2 / 2 ) + 8sin(<(>) 

For no phase retardation at the annulus of the objective mask, $ = 0, the 
value of the time average reduces to (a 2 / 2). This is the same as that of 

1 5 the time average of S 0 2 representing the light that is not deviated by the 

specimen. Or, as is well known, Phase Objects cannot be imaged with 
traditional techniques such as brightfield that do not compensate for phase 
in the undeviated and diffractive light. With Phase Contrast techniques, such 
as with <j> = pi/2 at the objective mask annulus, Phase Objects can be 

20 imaged clearly and distinctly from the background image. 

Although Phase Contrast Imaging techniques effectively produce high 
contrast images of Phase Objects, these techniques do not allow a large 
• depth of field or control of general focus-related aberrations. A large depth 
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of field is important when imaging objects that have a depth that is large in 
relation to the depth of field of the system or when making a very low cost 
imaging system. 

There is a need to improve Contrast Imaging of Phase Objects by increasing 
depth of field and controlling focus-related aberrations. 

SI 1MMARY OF THE INVENTION 

An object of the present invention is to improve Contrast Imaging of Phase 
Objects by increasing depth of field and controlling focus-related 
aberrations. This is accomplished by using Contrast Imaging apparatus and 
methods with Wavefront Coding aspheric optics and post processing to 
j ncrease depth of field and reduce misfocus effects. Increasing depth of field 
is important when imaging Phase Objects with large depth. Controlling 
focus-related aberrations is important when making inexpensive Contrast 
Imaging systems. 

Wavefront Coding can be used in conjunction with Phase Contrast imaging 
techniques to produce systems that have both a large depth of field and 
high contrast imaging of Phase Objects. The general Phase Contrast 
imaging system is modified with a special purpose optical element and image 
processing of the detected image to form the final image. Unlike the 
traditional Phase Contrast imaging system, the final image using Wavefront 
Coding is not directly available at the image plane. Post processing of the 
detected image is required. The Wavefront Coding optical element can be 
fabricated as a separate component, can be formed integrally with the 
objective mask, or can be constructed as an integral component of the 
imaging objective or tube lens, or any combination of such. 

A Wavefront Coding optical element can also be used on the illumination side 
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of the system in order to extended the depth of field of the projected 
illumination due to the duality of projection and imaging. This projected 
illumination would be broader than without Wavefront Coding, but the optical 
density as a function of distance from the object would be less sensitive 
5 with Wavefront Coding than without. Without Wavefront Coding on the 

illumination side of the system, the object can technically be imaged clearly 
but is not illuminated sufficiently. See "Principal of Equivalence between 
Scanning and Conventional Optical Imaging Systems", Dorian Kermisch, J. 
Opt. Soc. Am,, Vol. 67, no. 10, pp.1357-1360 (1977). 

I 0 The main component of importance for the Wavefront Coding imaging optics 

and digital processing in Phase Contrast systems is the objective mask, as 
opposed to the illumination mask. Without the objective mask, the imaging 
side of the system (as opposed to the illumination side) is very similar to a 
traditional imaging system used for imaging non-Phase Objects. The 

1 5 illumination mask can be considered as only required to alter the illumination 

light of the given object being imaged. Since many combinations of 
illumination configuration and object can produce the same transmitted (or 
reflected) wavefront, we can consider the use of specialized illumination as a 
means of altering the object's imaging characteristics when the object itself 

20 cannot be altered. The illuminated object is imaged through optics that 

have been modified to enhance the type of wavefront that the specialized 
illumination system is providing. Only changes in the objective mask 
necessitate changes in the optics or processing with Wavefront Coding. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 Figure 1 (prior art) is a block diagram showing a conventional Phase 

Contrast Imaging system. 

Figure 2 (prior art) is a side view showing an illumination mask and several 
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objective masks for use in the Phase Contrast Imaging system of Figure 1, 

Figure 3 (prior art) is a schematic diagram showing passage of undeviated 
and diffracted light in the Phase Contrast Imaging system of Figure 1. 

Figure 4 shows a Wavefront Coding Phase Contrast imaging system including 
5 Wavefront Coding and post processing in accordance with the present 

invention. 

Figure 5 includes plots showing the objective mask transmittance function 
and the corresponding ambiguity function for the Phase Contrast Imaging of 
Figure 1, without the Phase Contrast components. 

1 o Figure 6 includes plots showing the objective mask phase function and the 

corresponding ambiguity function for the Wavefront Coding Phase Contrast 
Imaging of Figure 4, without the Phase Contrast components. 

Figure 7 includes plots showing the objective mask phase and transmittance 
functions and the corresponding ambiguity function for the Phase Contrast 
1 5 Imaging system of Figure 1. 

Figure 8 includes plots showing the objective mask phase and transmittance 
functions and the corresponding ambiguity function for a configuration of 
the Wavefront Coding Phase Contrast Imaging system of Figure 4. 

Figure 9 includes plots showing the objective mask phase and 
20 transmittance functions and the corresponding ambiguity function for 

another configuration of the Wavefront Coding Phase Contrast imaging 
system of Figure 4. 

Figure 10 includes plots showing MTFs as a function of misfocus for the 
prior art Phase Contrast system of Figure T, and MTFs as a function of 
25 misfocus for the Wavefront Coding Phase Contrast imaging system of Figure 

1 0 
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4, with the configurations of Figures 8 and 9. 

Figure 11 is images of many planes of focus of a diatom imaged with a 40X, 
NA=1.3 objective, produced both by the traditional Phase Contrast Imaging 
system of Figure 1, and the Wavefront Coding Phase Contrast Imaging 
5 system of Figure 4. 

DFTAILFD DESCRIPTION OF THE PREFFRRED EMBODIMENTS 

Wavefront Coding can be integrated with traditional objectives and objective 
masks in Phase Contrast systems, as shown in Figure 4, to achieve an 
increased depth of field in an optical and digital imaging system that also 
1 0 images Phase Objects 108. This is illustrated through inspection of the 

ambiguity functions and modulation transfer functions (MTFs) of the related 
traditional, Phase Contrast systems, and Wavefront Coded Phase Contrast 
imaging systems, as shown in Figures 5-10. Figure 11 shows real-world 
images taken with a Phase Contrast Imaging system of Figure 1 and 

1 5 comparison images taken by the Wavefront Coding Phase Contrast system 

of Figure 4. 

Figure 4 shows a Wavefront Coding Phase Contrast Imaging system 400 
including specialized aspheric optics and post processing in accordance with 
the present invention. The general Phase Contrast imaging system of Figure 

2 0 1 is modified with a special purpose generalized aspheric optical element 

422 and image processing 424 of the detected image to form the final 
image. Unlike the traditional imaging system, the final image in the 
Wavefront Coded system 400 is not directly available at image plane 418. 
In fact, no sharp and clear image of any kind is available in system 400 at 
25 image plane 418. Post processing 424 of the detected image is required, to 

remove the Wavefront Coding effects (other than the extended depth of 
field). 
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Wavefront Coding optical element 422 can be fabricated as a separate 
component as shown in Figure 4, can be formed integrally with objective 
mask 412, or can be constructed as an integral component of imaging 
objective 410 or tube lens 414. Any material or configuration that can 
5 impart a range of spatial phase shifts to a wavefront can be used to 

construct Wavefront Coding element 422. For example, optical glass or 
plastic of varying thickness and/or index of refraction can be used. 
Holograms, mirrors, and diffractive optical elements can also be used as the 
material for the Wavefront Coding element. In order to dynamically adjust 
1 0 the amount of depth of field, or to essentially change the Wavefront Coding 

element 422 for different objectives, spatial light modulators or micro- 
mechanical mirrors can also be used. 

Similar reference numbers are used in Figure 4 as are used in Figure 1, since 
the systems are very similar, except for the addition of Wavefront Coding 

1 5 element 422 and post processing 424. 

Wavefront Coding optical element 422 can also be used on the illumination . 
side of system in order to extend the depth of field of the projected 
illumination due to the duality of projection and imaging. This projected 
illumination would be broader than without Wavefront Coding, but the optical 

2 0 density as a function of distance from the object would be less sensitive 

with Wavefront Coding than without. 

The main component of importance in Wavefront Coding Phase Contrast 
systems 400 is objective mask 412, as opposed to illumination mask 406. 
Illumination mask 406 can be considered as mainly required to alter the 
2 5 transmitted (or reflected) light from object 408. Only changes in objective 

mask 412 necessitate changes in Wavefront Coding element 422 or Image 
Processing 424. For example, consider covering part of the area of 

12 
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illumination mask 106a so that no light can pass through part of the 
surface. With this change the objective mask is no longer matched to the 
illumination mask, but because of the theory of operation of Phase Contrast 
systems, Phase Objects will still be visible in the Phase Contrast and 
Wavefront Coded Phase Contrast images. Such a change in the illumination 
mask will not require a change to the imaging part of the system in order to 
view Phase Objects in the formed images. As another example, assume that 
the objective mask is changed, e.g. assume that one of the objective masks 
112a, 112b, or 112c is substituted for another. These changes will not 
require a different illumination mask but could require changes in the 
Wavefront Coding optics and digital post processing. 

Figure 5 shows the objective mask transmittance function and the 
corresponding ambiguity function for the prior art system of Figure 1, 
without Phase Contrast modifications. Only the magnitude of the ambiguity 
functions in this and following figures are shown. Ambiguity functions are, in 
general, complex functions. One-dimensional systems are given for simplicity. 
Those skilled in the art of linear systems and ambiguity function analysis can 
quickly make extensions to two-dimensional systems. An ambiguity function 
representation of the optical system is a powerful tool that allows MTFs to 
be inspected for all values of misfocus at the same time. Essentially, the 
ambiguity function representation of a given optical system is similar to a 
polar plot of the MTF as a function of misfocus. The in-focus MTF is 
described by the trace along the horizontal v=0 axis of the ambiguity 
function. An MTF with normalized misfocus value of y =[ 2 pi X W 20 ], 
where W 20 is the traditional misfocus aberration coefficient and X is the 
illumination center wavelength, is described in the ambiguity function along 
the radial line with slope equal to (y I pi). For more information on 
ambiguity function properties and their use in Wavefront Coding see 
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"Extended Depth of Field Through Wavefront Coding", E. R. Dowski and W.T. 
Cathey, Applied Optics, vol. 34, no 11, pp. 1859-1866, April, 1995, and 
references contained therein. 

Returning to Figure 5, the top plot shows the objective mask transmittance 
5 function of a conventional system such as that shown in Figure 1, without 

either an illumination mask 106 or an objective mask 112. In other words, 
Figure 5 applies to a conventional imaging system without Phase Contrast 
modifications. The bottom plot shows the associated ambiguity function. 

Over the normalized aperture (in normalized coordinates extending from -1 
10 to +1) the ideal system has a transmittance of 1, i.e. 100%. The phase 

variation (not shown) is equal to zero over this range. The corresponding 
ambiguity function has concentrations of optical power (shown as dark 
shades) very close to the horizontal v=0 axis. From the relationship 
between the ambiguity function and misfocused MTFs, we see that the 

1 5 diffraction limited imaging system has a small depth of field because slight 

changes in misfocus lead to MTFs (represented by radial lines with non-zero 
slope in the ambiguity function) that intersect regions of small power 
(represented by lighter shades of gray or white regions). 

Figure 6 shows a Wavefront Coding phase function and corresponding 

2 0 ambiguity function for an improved system of Figure 4, but without 

illumination mask 406 or objective mask 412. Thus, this plot illustrates a 
system having Wavefront Coding, but not Phase Contrast Imaging. 
Modifying the ideal diffraction limited system associated with Figure 5 with 
Wavefront Coding element 422 results in the plots of Figure 6. As an 
2 5 example, a rectangularly separable complex phase function for this system 

is given as: 

phase(x,y) .= exp( j 12 [x 3 +y 3 ]), 
14 
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Ixl <1, !yl <1, j = sqrt(-1) 

Increasing the peak-to-valley phase height (as can be done by increasing the 
constant 12 above) results in increasing depth of field. The transmittance 
of this system (not shown) is unity (i.e. 100%) over the entire aperture, as 
5 in the top plot of Figure 5. 

Other more general rectangularly separable forms of the Wavefront Coding 
complex phase are given by: 

phase(x,y) = exp( j * [ 2 a, sign(x) Ixl b , + c,sign(y) lyl d / ] ) 
where the sum is over the index /. Sign(x) = -1 for x < 0, +1 for x > 0. 

1 o Rectangularly separable forms of Wavefront Coding allow fast processing. 

Other forms of Wavefront Coding complex phases are non-separable, and 
the sum of rectangularly separable forms. One non-separable form is 
defined as: 

phase(r.e) = exp( j * [Z r a / cos( b,.0 + <>,)]) 

where the sum is again over the subscript i. In general, there are an infinite 
number of different phase functions that can be used in Wavefront Coding 
Phase Contrast systems. 

The ambiguity function shown in Figure 6 for this Wavefront Coded system is 
seen to have optical power spread over a much larger region in the 
ambiguity domain than does the diffraction-limited system plotted in Figure 
5. Broader regions of optical power in the ambiguity function translate to 
larger depth of field or depth of focus since the ambiguity function is 
essentially a radial plot of misfocused MTFs with the angular dimension 
pertaining to misfocus. 
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Figure 7 shows the objective mask phase and transmittance functions and 
the corresponding ambiguity function for the prior art system of Figure 1 , 
including Phase Contrast masks 106a and 112b as shown in Figure 2. Thus, 
these plots illustrate a system having Phase Contrast Imaging, but not 
Wavefront Coding. Again, a one-dimensional example is shown. The 
transmittance for this system, seen in the upper right plot, is 100% for the 
majority of the surface and 50% for the region that represents the annular 
region 206 of objective mask 112b. The phase variation of the objective is 
equal to zero over the majority of the surface, and -pi/2 for the region that 
represents the annular region 206 of objective mask 112b. 

The corresponding ambiguity function for this phase contrast system in the 
lower plot of Figure 7 is seen to differ from the diffraction-limited system 
represented in Figure 5. The optical power near the v=0 axis is slightly 
broader then that of the diffraction-limited system, and much power is seen 
to be non-uniformly positioned off the v=0 axis as well. As the total volume 
under an ambiguity function is constant, any power away from the v=0 axis 
in effect lowers the power at other regions where it is desirable to have high 
power. The differences in this ambiguity function compared to that of 
Figure 5 are due mainly from the -pi/2 phase steps in the objective mask 
phase function, and to a lesser extent, the transmittance reduction of the 
objective mask. 

Figure 8 shows the objective mask and Wavefront Coding phase function 
and transmittance functions, and the ambiguity function for the improved 
system of Figure 4, using Phase Contrast objective mask 112b as shown in 
Figure 2. Thus, the Wavefront Coded Phase Contrast Imaging system is 
illustrated'in Figure 8. The phase function is seen to not be a simple binary 
function but a continually varying function with peak-to-valley phase changes 
of about +/- 12 radians. The transmittance function is the same as shown 
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in Figure 7. The form of the objective mask phase profile, in radians, of this 
system is given by: 

Phase profile(x) « 12 - (pi/2)[ U((x-0.6)*10 ) + U«x+0.6)*10) ], 

ixl <= 1 

5 Where U(z) = 1 for Izl < 1 

a 0 otherwise 

The system's ambiguity function is seen to have more optical power 
uniformly spread about the horizontal v=0 axis when compared to either the 
Phase Contrast system plotted in Figure 7 or the diffraction limited system 
1 0 plotted in Figure 5. Thus, the Wavefront Coded Phase Contrast system will 

have a larger depth of field than the general Phase Contrast system. 
Although not apparent from the prior art descriptions of Phase Contrast 
imaging, such as that shown in Figure 3, the Wavefront Coding Phase 
Contrast imaging system delivers a large depth of field while also imaging 

1 5 Phase variations of the object into intensity variations of the image. 

Figure 9 shows another set of phase and transmittance functions and the 
ambiguity function for a further improved system of Figure 4, using Phase 
Contrast objective masks 112b as shown in Figure 2. The phase function is 
seen to be not a simple binary function but is a continually varying function 

2 0 with peak-to-valley phase changes of about +/- 5 radians. This phase 

function is seen to be relatively close to zero over a larger portion of the 
center of the aperture than the phase function of figure 8. The 
transmittance function is the same as shown in Figure 7. The phase profile 
of this system is given by: 

2 5 Phase prof ile(x) = 3 sign(x) Ixl 3 + 3 sign(x) Ixl 9 - 6 



17 



WO 02/099511 



PCT/US02/01304 



- (pi/2) [ U((x-0.6)*10 ) + U((x+0.6)*10) ] 



for Ixl <= 1, and where U(z) = 1 for Izl < 1 

= 0 otherwise 

5 The Wavefront Coded system ambiguity function of Figure 9 is seen to have 

a similar uniform arrangement of optical power about the v=0 axis as from 
Figure 8. Thus, this Wavefront Coded Phase Contrast system will also have 
a larger depth of field than the general Phase Contrast system, while also 
imaging phase variations of the objects, as intensity variations in the image. 

1 0 Since this ambiguity function is more compactly represented about the v=0 

axis than that of Figure 8 it will yield higher MTFs over a range of misfocus 
than the system of Figure 8 while also minimizing the effects of misfocus on 
the MTFs. As a consequence of higher MTFs, the size of the point spread 
functions (PSFs) (not shown) for the system of Figure 9 is less than the size 
15 of the PSFs for the system of Figure 8. Smaller PSF size translates to less 

post processing required to produce the final images. 

The top plot of Figure 10 shows the MTFs of the Phase Contrast imaging 
system (specifically the prior art system of Figure 1, using Phase Contrast 
as in Figure 2 with objective mask 112b), and the MTFs of the Wavefront 
20 Coded Phase Contrast system of Figure 8. The bottom plot shows the 

MTFs of the Phase Contrast imaging system and the MTFs from the 
Wavefront Coding Phase Contrast imaging system of Figure 9. These plots 
are the particular MTFs given in the respective ambiguity functions for the 
normalized misfocus values y = { 0 , 2, 4 }. Notice that the MTFs for the 

2 5 Phase Contrast system (top and bottom plots) vary appreciably with even 

this slight amount of misfocus. The image will thus change drastically due to 
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misfocus effects in the Phase Contrast system for only small, normalized 
misfocus values. This is expected from the ambiguity function associated 
with this system (shown in Figure 7). By comparison, the MTFs from the 
Wavefront Coded Phase Contrast imaging systems (top and bottom plots) 
show very little change with misfocus as predicted by the ambiguity 
functions associated with these systems (shown in Figures 8 and 9). If the 
MTFs of the system do not change, the resulting MTFs (and hence also point 
spread functions) can be corrected over a large range of misfocus with a 
single post processing step 424. This is not possible with systems that do 
not have a large depth of field since the MTFs and PSFs representing the 
images change with misfocus to values that are unknown and often 
impossible in practice to calculate. The MTFs from the Wavefront Coded 
Phase Contrast system in the top plot are seen to have lower values for 
most spatial frequencies than the MTFs from the Wavefront Coded Phase 
Contrast system of the bottom plot. This is expected from the ambiguity 
functions of Figures 8 and 9 respectively. The more sophisticated two-term 
phase function yields MTFs that not only have similarly small change with 
misfocus but also give a higher MTF. This higher MTF results in a more 
compact PSF (not shown) as well as less signal-to-noise ratio penalties 
needed for the image processing 424. 

In essence, the image processing function 424 restores the Wavefront 
Coding Phase Contrast transfer functions to those expected from the 
traditional Phase Contrast system with no misfocus. Since all the Wavefront 
Coding MTFs from a given system are essentially identical, after image 
processing 424 all MTFs (and hence all PSFs) will be nearly identical for each 
value of misfocus. The image processing function, though, is dependent on 
the type of phase function used. For example, the phase functions in Figures 
8 and 9 are different from each other and correspond to ambiguity 
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functions and MTFs that are also different from each other. The 
corresponding image processing functions for the two systems represented 
by Figures 8 and 9 are then also different from each other. 

Notice that the MTFs from the Wavefront Coding Phase Contrast system of 
5 Figure 4 (upper and lower plots of Figure 10) essentially do not change with 

misfocus but also do not have the same shape as that of the in-focus MTF 
(\jf= 0) of the Phase Contrast system. In the spatial domain, the Wavefront 
Coding Phase Contrast systems form images with a specialized blur where 
the blur is insensitive to the amount of misfocus or the presence of other 
I 0 focus related aberrations. The Image Processing function 424 of Figure 4 is 

used to remove this blur. The Image Processing function is designed such 
that the MTFs and PSFs of the Wavefront Coding Phase Contrast system, 
over a range of misfocus, after processing closely match that of the in- 
focus Phase Contrast system. The image Processing function can also 

1 5 produce an effective MTF after processing that has more or less contrast 

than the in-focus Phase Contrast system depending on the needs of the 
particular application. 

More specifically, the image processing function, say F, implements a 
transformation on the blurred Wavefront Coding Phase Contrast system 
20 image, say H WFC , so that after processing the system has an ideal response 

designated H jdea! . Typically, the ideal response is chosen as the in-focus 
response of the general Phase Contrast system. If implemented as a linear 
filter, then F is (in the spatial frequency domain) equivalent to: 

F(w) H WFC (w) = H ideaI (w) 

2 5 where w denotes a spatial frequency variable. If the ideal response is fixed, 

then changing the Wavefront Coding Phase Contrast system H WFC changes 
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the image processing function F. The use of a different objective mask or 
Wavefront Coding phase function can cause a change in the image 
processing function. In practice, it is common to to be able to measure 
slight changes in the Wavefront Coding Phase Contrast imaging system as a 
function of misfocus. In this case, the image processing function F is chosen 
as a best fit between the measured data and the desired system after 
processing. 

There are many linear and non-linear prior art techniques for removing 
known and unknown blur in images. Computationally effective techniques 
include rectangularly separable or multi-rank linear filtering. Rectangularly 
separable linear filtering involves a two step process where the set of one- 
dimensional columns are filtered with a one dimensional column filter and an 
intermediate image is formed. Filtering the set of one-dimensional rows of 
this intermediate image with a one-dimensional row filter produces the final 
image. Multi-rank filtering is essentially the parallel combination of more than 
one rectangularly separable filtering operation. A rank N, digital filter kernel 
can be implemented with rectangularly separable filtering by using N 
rectangularly separable filters in parallel. 

The form of the processing (rectangularly separable, multi-rank, 2D kernel, 
etc.) is matched to that of the Wavefront Coding element. Rectangularly 
separable filtering requires a rectangularly separable Wavefront Coding 
element. The elements described in Figure 6, 8, and 9 are all rectangularly 
separable. 

Figure 11 is an image of a diatom taken with a conventional 40X, NA=1.3 
Phase Contrast system similar to that of Figure 1 , and an image of the 
same diatom taken with a 40X, NA=1.3 Wavefront Coding Phase Contrast 
system similar to that of Figure 4. The top set of images was produced by 
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the conventional 40X Phase Contrast system. The bottom set of images 
was produced by the Wavefront Coding Phase Contrast system. Comparing 
the images from left to right, object distance was varied by 2 microns 
farther away from the objective for each image compared to the image on 

5 its left. The bottom row Wavefront Coded Phase Contrast images are the 

final images produced after image processing of the detected image. 
Rectangularly separable digital filtering was used. Notice the strong 
brighter and darker intensity variations verses the gray background (or 
phase shading) visible on the top row (40X/1.3 Phase Contrast) images. 

| 0 This is a characteristic of Phase Contrast imaging. Notice also that many 

parts of the Phase Contrast images are blurred due to misfocus effects. In 
particular, the image of the central region of the diatom changes drastically 
with changes in misfocus. The halo seen on the outer region of the diatom is 
a misfocus effect. The characteristic Phase Contrast shading and very large 

1 5 extended depth of field are both seen in the Wavefront Coding images. In 

fact, some objects that have too much change in depth to be in focus at 
any one focus position in a traditional Phase Contrast system will be entirely 
in focus in the Wavefront Coding Phase Contrast system of the present 
invention. 

20 As shown in Figures 8, 9, 10, and 11, the Wavefront Coding Phase Contrast 

imaging system essentially removes the effects of misfocus on the final 
images. The Wavefront Coding Phase Contrast system will control the 
misfocus effects independent of the source of the misfocus. When increasing 
the depth of field, as shown in Figure 11, the misfocus effects are produced 

25 by the object not being in the best focus position relative to the imaging 

optics. Misfocus effects can also be produced by non-ideal optics, 
temperature changes, mechanical positioning errors, and various other 
sources of optical aberrations. Controlling all of these misfocus effects (and 
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not simply those related to object positioning) allows inexpensive systems 
to be produced that image with surprisingly high quality. 

For example, if objective lens 410 of Figure 4 has a noticeable amount of 
chromatic aberration, then misfocus effects will be produced as a function 
5 of illumination wavelength. The Wavefront Coding Phase Contrast system 

controls the chromatic aberration misfocus effects in conjunction with depth 
of field related object misfocus effects. Other optical aberrations that can 
similarly be controlled include petzval curvature, astigmatism, spherical 
aberration, temperature related misfocus, and fabrication or alignment 
1 0 related misfocus. Any aberration that can be theoretically or practically 

improved in prior art systems by changing the focus position can also be 
corrected and improved in Wavefront Coding Phase contrast systems. 

The Wavefront Coded objective mask phase functions of Figures 8 and 9 
describe two configurations of the specialized optics of Wavefront Coding. 

1 5 There are in general an infinite number of different Wavefront Coding phase 

functions (or Wavefront Coding optics) that can be used with any 
Wavefront Coding system. Different Wavefront Coding phase functions can 
be preferred for a variety of factors. Examples of such factors include 
small changes of the corresponding MTFs with misfocus aberrations, 

20 corresponding MTFs with high values, corresponding compact PSFs, ease of 

required processing, or for ease of fabrication of the optical element itself. 

The characteristics that practical Wavefront Coding mask phase functions 
have can generally be described as being relatively flat near the center of 
the aperture with increasing and decreasing phase near the ends or edges 
25 of the aperture. The central portion of the phase function controls the 

majority of the light rays that would not need modification if the objective 
were stopped down, for the particular amount of extended depth of field 
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required. For increasing amounts of depth of field, the size of the central 
phase region that can ideally be flat decreases. Increasing the flatness of 
the central region of the rays leads to larger MTFs as seen in comparison to 
the phase functions and MTFs of Figures 8 f 9, and 10. The edge portions of 
the phase function control the light rays that increase the light gathering 
and spatial resolution of the full aperture system, but that without 
modifications cause the largest amount of misfocus effects in traditional 
systems. It is these edge rays that should be the most modified by the 
objective mask phase function. It is also these edge rays that control the 
variation of the MTFs and PSFs with misfocus. 

What is claimed is: 
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CLAIMS 

1 . Apparatus (400) for increasing depth of field and controlling focus 
related aberrations in a Phase Contrast Imaging system having an 
illumination source (402), illumination optics ()404, and an illumination mask 
(406) placed before a Phase Object (408) to be imaged, and an objective 

5 mask (412) and objective optics (414) after the Phase Object to form an 

image (418) at a detector (420), the improvement comprising: 

an optical Wavefront Coding element (422) having an aperture and placed 
between the Phase Object and the detector, 

said coding mask being constructed and arranged to alter the optical 

1 0 transfer function of the Phase Contrast Imaging system in such a way that 

the altered optical transfer function is substantially insensitive to the 
distance between the Phase Object and the objective optics over a greater 
range of object distances than was provided by the unaltered optical 
transfer function, 

15 wherein the coding mask affects the alteration to the optical transfer 

function substantially by affecting the phase of light transmitted by the 
mask; and 

a post processing element (424) for processing the image captured by the 
detector by reversing the alteration of the optical transfer function 

2 0 accomplished by the coding mask. 

2. The apparatus of claim 1 wherein the detector is a charge coupled 
device (CCD). 

3. The apparatus of claim 1, wherein the phase of light transmitted by 
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the coding mask substantially follows a cubic function. 

4. The apparatus of Claim 1, wherein the phase of light transmitted by 
the coding mask is relatively flat near the center of the aperture with 
increasing and decreasing phase near respective ends of the aperture. 

5. The apparatus of claim 4, wherein the phase of light transmitted by 
the coding mask is a smoothly varying function having peak to valley phase 
changes of about +5 radians to -5 radians. 

6. The apparatus of claim 4, wherein the phase of light transmitted by 
the coding mask is a smoothly varying function having peak to valley phase 
changes of about +12 radians to -12 radians. 

7. The apparatus of claim 4, wherein the phase of light transmitted by 
the coding mask substantially follows a sum of powers function of the form: 

phase(x,y) = exp( sign(x) Ixl b ,.+ c,sign(y) lyl d ,] ), 

where sum I is over the subscript i; and 
where sign(x) = -1 for x < 0 P +1 for x > 0, and j = sqrt (-1). 

The apparatus of claim 1, wherein the phase of light transmitted by 
the coding mask substantially follows a non-separable function of the 
form: 

phase(r,6) = exp( j * [S r a ,.cos( b,e + $, )]) 
5 where sum I is over the subscript I, and j = sqrt (-1). 

9. The apparatus of claim 1, wherein the coding mask further comprises 
a lens element for focussing the light. 
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10. The apparatus of claim 1, wherein the coding mask is integrally 
formed with the objective mask. 

11. The apparatus of claim 10, wherein the objective optics are further 
integrally formed with the coding mask and the objective mask. 

12. The apparatus of claim 1, wherein the coding mask comprises one of 
the following: 

an optical material having varying thickness. 

an optical material having varying index of refraction. 

spatial light modulators. 

micro-mechanical mirrors. 
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13. The method for increasing depth of field and controlling focus related 
aberrations in a conventional Phase Contrast Imaging system having an 
illumination source, illumination optics, and an illumination mask placed before 
a Phase Object to be imaged, and an objective mask and objective optics 
after the Phase Object to form an image at a detector, the method 
comprising the steps of: 

between the Phase Object and the detector, modifying the wavefront of 
transmitted light; 

the wavefront modification step selected to alter the optical transfer 
function of the Phase Contrast Imaging system in such a way that the 
altered optical transfer function is substantially insensitive to the distance 
between the Phase Object and the objective optics over a greater range of 
object distances than was provided by the unaltered optical transfer 
function; and 

post processing the image captured by the detector by reversing the 
alteration of the optical transfer function accomplished by the mask. 

14. The method of claim 13, wherein the phase of light transmitted by the 
mask substantially follows a cubic function. 

15. The method of Claim 13, wherein the modifying step modifies the 
phase of light transmitted according to a profile which is relatively flat near 
the center of the aperture with increasing and decreasing phase near 
respective ends of the aperture. 

16. The method of claim 13, wherein the phase of light transmitted by the 
mask substantially follows a sum of powers function of the form: 

phase(x,y) = exp( j * [ Z a,. sign(x) Ixl b ,.+ c,sign(y) lyl d ,] ), 
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where sum I is over the subscript i; and 

5 where Sign(x) = -1 for x < 0, +1 for x > 0. 

17. The method of claim 13, wherein the phase of light transmitted by the 
mask substantially follows a non-separable function of the form: 

phase(r.e) = exp( j * [I r^cosC b , e + ♦/)!) 

where sum I is over the subscript i. 
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